add new feature for EC-RAG by Yongbozzz · Pull Request #2423 · opea-project/GenAIExamples

Yongbozzz · 2026-03-11T08:13:00Z

Description

add new feature for EC-RAG ：

decouple knowledge base and pipeline
support local OV inference for Agent
known issue fix and docs/scripts enhancement

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

[√ ] New feature (non-breaking change which adds new functionality)

Dependencies

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

github-actions · 2026-03-11T08:13:13Z

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

None

Copilot

Pull request overview

This PR introduces EC-RAG “knowledge base ↔ pipeline” decoupling, reworks UI flows to manage Knowledge Bases separately from Pipelines, and adds Kubernetes Helm deployment artifacts alongside various docs/test updates.

Changes:

Refactors backend pipeline execution to retrieve from multiple active knowledge bases (KB-driven indexing; pipeline holds retriever/generator config).
Reworks the UI Knowledge Base module (new create/edit/detail flows for “knowledge” vs “experience”), and simplifies pipeline editing steps accordingly.
Adds Helm chart manifests/config and updates scripts/tests/docs to align with the new KB/pipeline model.

Reviewed changes

Copilot reviewed 73 out of 75 changed files in this pull request and generated 12 comments.

Show a summary per file

File	Description
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/enum.ts	Removes kbadmin options from pipeline enums
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/UpdateDialog/index.ts	Drops NodeParser/Indexer steps from pipeline update dialog exports
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/UpdateDialog/Retriever.vue	Simplifies retriever config UI logic
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/UpdateDialog/NodeParser.vue	Removes pipeline NodeParser step (file deleted)
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/UpdateDialog/EditDialog.vue	Reduces pipeline edit steps to retriever/post/generator/active
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/UpdateDialog/CreateDialog.vue	Reduces pipeline create steps to 5 total
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/Table.vue	Formatting/import adjustments
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/components/DetailDrawer.vue	Removes NodeParser/Indexer detail sections
EdgeCraftRAG/ui/vue/src/views/settings/components/Pipeline/columnsList.ts	Simplifies columns (shows retriever/postProcessor by default)
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/index.vue	Adds knowledge-specific create/edit/detail UI + disables edit when active
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/index.ts	Re-exports new dialogs/drawer components
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/index.ts	New KB dialog step exports
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/enum.ts	New KB-only node parser/indexer enums
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/NodeParser.vue	New KB NodeParser step UI
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/Indexer.vue	New KB Indexer step UI w/ kbadmin handling
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/EditDialog.vue	New KB edit wizard modal
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/CreateDialog.vue	New KB create wizard modal
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/Basic.vue	New KB basic info step (origin vs kbadmin)
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateKBDialog/Activated.vue	New KB active toggle step
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateExperienceDialog.vue	New experience create/edit modal
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/UpdateDialog.vue	Removes old combined UpdateDialog (file deleted)
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/KnowledgeDetail.vue	Adds file pagination + uses new filemap API
EdgeCraftRAG/ui/vue/src/views/chatbot/components/KnowledgeBase/DetailDrawer.vue	New KB configuration detail drawer
EdgeCraftRAG/ui/vue/src/theme/common.less	Minor formatting + adds (commented) horizontal-form-item deep block
EdgeCraftRAG/ui/vue/src/i18n/zh.ts	Adds KB UI strings and wording updates
EdgeCraftRAG/ui/vue/src/i18n/en.ts	Adds KB UI strings and wording updates
EdgeCraftRAG/ui/vue/src/auto-imports.d.ts	Regenerates auto-import typings formatting
EdgeCraftRAG/ui/vue/src/api/knowledgeBase/index.ts	Adds KB json/files APIs + kbadmin list params
EdgeCraftRAG/ui/vue/components.d.ts	Regenerates components typings
EdgeCraftRAG/tools/quick_start.sh	Renames env vars (TP/QUANTIZATION/ZE_AFFINITY_MASK)
EdgeCraftRAG/tests/test_pipeline_local_llm.json	Removes embedded node_parser/indexer config
EdgeCraftRAG/tests/test_pipeline_ipex_vllm.json	Removes embedded node_parser/indexer config
EdgeCraftRAG/tests/test_compose_vllm_on_arc_b60.sh	Switches “add data” to knowledge-base flow
EdgeCraftRAG/tests/test_compose_vllm_on_arc.sh	Switches “add data” to knowledge-base flow + TP
EdgeCraftRAG/tests/test_compose_on_arc.sh	Switches “add data” to knowledge-base flow
EdgeCraftRAG/tests/configs/test_pipeline_local_llm.json	Removes embedded node_parser/indexer config
EdgeCraftRAG/tests/configs/test_pipeline_ipex_vllm.json	Removes embedded node_parser/indexer config
EdgeCraftRAG/tests/configs/test_kb.json	Adds KB config used by tests
EdgeCraftRAG/tests/configs/test_data.json	Removes old data payload (file deleted)
EdgeCraftRAG/tests/common.sh	Adds validate_knowledge helper and common vars
EdgeCraftRAG/kubernetes/helm/values.yaml	New Helm values for stack
EdgeCraftRAG/kubernetes/helm/templates/service-llm-serving-xpu.yaml	New Service for vLLM daemonset
EdgeCraftRAG/kubernetes/helm/templates/service-edgecraftrag-ui.yaml	New UI NodePort service
EdgeCraftRAG/kubernetes/helm/templates/service-edgecraftrag-server.yaml	New pipeline server service
EdgeCraftRAG/kubernetes/helm/templates/service-ecrag.yaml	New mega service
EdgeCraftRAG/kubernetes/helm/templates/deployment-edgecraftrag-ui.yaml	New UI deployment
EdgeCraftRAG/kubernetes/helm/templates/deployment-ecrag.yaml	New ecrag deployment
EdgeCraftRAG/kubernetes/helm/templates/daemonset-llm-serving-xpu.yaml	New vLLM daemonset
EdgeCraftRAG/kubernetes/helm/templates/daemonset-edgecraftrag-server.yaml	New server daemonset
EdgeCraftRAG/kubernetes/helm/templates/configmap-env.yaml	New ConfigMap for env wiring
EdgeCraftRAG/kubernetes/helm/README_zh.md	New Helm deployment doc (ZH)
EdgeCraftRAG/kubernetes/helm/README.md	New Helm deployment doc (EN)
EdgeCraftRAG/kubernetes/helm/Chart.yaml	New Helm chart metadata
EdgeCraftRAG/edgecraftrag/controllers/pipelinemgr.py	Activates pipeline using active KB list; removes node/index cache logic
EdgeCraftRAG/edgecraftrag/controllers/knowledge_basemgr.py	Supports multiple active KBs + stores origin_json
EdgeCraftRAG/edgecraftrag/controllers/filemgr.py	Switches file operations to take file_path
EdgeCraftRAG/edgecraftrag/config_repository.py	Persists KB config from stored KB json
EdgeCraftRAG/edgecraftrag/components/retriever.py	Simplifies KBadmin retriever; BM25 guard for milvus
EdgeCraftRAG/edgecraftrag/components/pipeline.py	Stores retriever config + builds retrievers per active KB
EdgeCraftRAG/edgecraftrag/components/knowledge_base.py	Moves node_parser/indexer into Knowledge; tracks nodes and origin_json
EdgeCraftRAG/edgecraftrag/components/indexer.py	Adjusts collection naming; moves kbadmin milvus mapping here
EdgeCraftRAG/edgecraftrag/api_schema.py	Moves node_parser/indexer from PipelineCreateIn to KnowledgeBaseCreateIn
EdgeCraftRAG/edgecraftrag/api/v1/system.py	Updates OpenVINO import style
EdgeCraftRAG/edgecraftrag/api/v1/pipeline.py	Pipeline update now only stores retriever config + activation wiring
EdgeCraftRAG/edgecraftrag/api/v1/data.py	Removes /v1/data ingestion; nodes now KB-driven
EdgeCraftRAG/edgecraftrag/api/v1/chatqna.py	Uses list of active KBs in request.user
EdgeCraftRAG/edgecraftrag/api/v1/agent.py	Updates activation wiring for KB list
EdgeCraftRAG/edgecraftrag/VERSION	Bumps version to 26.03-Dev
EdgeCraftRAG/docs/Quick_Start_Guide_Zh.md	Removes old quick start doc (file deleted)
EdgeCraftRAG/docs/API_Guide.md	Updates KB API examples to new flow
EdgeCraftRAG/docker_compose/intel/gpu/arc/set_env.sh	Renames env vars (TP/QUANTIZATION)
EdgeCraftRAG/docker_compose/intel/gpu/arc/compose.yaml	Renames env vars mapping for vLLM container
EdgeCraftRAG/docker_compose/intel/gpu/arc/README_zh.md	Adds expanded Arc deployment guide
EdgeCraftRAG/docker_compose/intel/gpu/arc/README.md	Updates Arc deployment guide + adds ZH link
EdgeCraftRAG/Dockerfile.server	Changes PPA suite from plucky → questing

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

for more information, see https://pre-commit.ci

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

add new feature for EC-RAG

8202313

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

Yongbozzz requested a review from myqi as a code owner March 11, 2026 08:13

Copilot AI review requested due to automatic review settings March 11, 2026 08:13

Copilot started reviewing on behalf of Yongbozzz March 11, 2026 08:13 View session

Copilot AI reviewed Mar 11, 2026

View reviewed changes

doc enhancement and Dockerfile fix

b7d4e69

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

Yongbozzz force-pushed the zyb_dev branch from 5971bde to b7d4e69 Compare March 12, 2026 02:11

remove helm for upstream

75b2ad3

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

Yongbozzz force-pushed the zyb_dev branch 2 times, most recently from d430814 to 75b2ad3 Compare March 12, 2026 03:08

update local ov support for agent

059d5e7

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

Yongbozzz force-pushed the zyb_dev branch from af67c15 to 059d5e7 Compare March 12, 2026 04:48

[pre-commit.ci] auto fixes from pre-commit.com hooks

5a0ec4b

for more information, see https://pre-commit.ci

Yongbozzz requested review from ZePan110 and lvliang-intel March 12, 2026 05:35

Yongbozzz added 2 commits March 12, 2026 13:38

update README

c74f221

Signed-off-by: Yongbozzz <yongbo.zhu@intel.com>

Merge remote-tracking branch 'temp/zyb_dev' into zyb_dev

92e19a7

lvliang-intel approved these changes Mar 12, 2026

View reviewed changes

ZePan110 approved these changes Mar 12, 2026

View reviewed changes

Yongbozzz merged commit 15b0d46 into opea-project:main Mar 12, 2026
25 of 27 checks passed

Yongbozzz deleted the zyb_dev branch March 12, 2026 07:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add new feature for EC-RAG#2423

add new feature for EC-RAG#2423
Yongbozzz merged 7 commits into
opea-project:mainfrom
Yongbozzz:zyb_dev

Yongbozzz commented Mar 11, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Mar 11, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

Yongbozzz commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Issues

Type of change

Dependencies

Uh oh!

github-actions Bot commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Dependency Review

Scanned Files

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Yongbozzz commented Mar 11, 2026 •

edited

Loading

github-actions Bot commented Mar 11, 2026 •

edited

Loading